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The Donsker-Varadhan rate function for occupation-time fluctuations has been 
seen numerically to exhibit monotone return to stationary nonequilibrium [Phys. 
Rev. Lett. 107, 010601 (2011)]. That rate function is related to dynamical activity 
and, except under detailed balance, it does not derive from the relative entropy for 
which the monotonicity in time is well understood. We give a rigorous argument that 
the Donsker-Varadhan function is indeed monotone under the Markov evolution at 
large enough times with respect to the relaxation time, provided that a "normal 
linear-response" condition is satisfied. 
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I. PHYSICAL MOTIVATION AND MAIN FINDING 

Equilibrium under given thermodynamic conditions is characterized by minimizing the 
appropriate thermodynamic potential. For example, for a given temperature and pressure 
of the environment, an open system finds its equilibrium condition from minimizing the 
Gibbs free energy. That is why water has to boil at around 100° Celsius under atmospheric 
pressure; that is the temperature above which the gas-phase of water gets a smaller Gibbs 
free energy. That minimization is also dynamically realized. Indeed, in many cases the sec- 
ond law of thermodynamics can be extended to become an H-theorem for the relaxation to 
equilibrium where the corresponding thermodynamic potential shows monotone decay to its 
equilibrium value. Close-to-equilibrium the situation then resembles the motion of a particle 
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in a parabolic well with statistical forces derived from gradients in the equilibrium thermo- 
dynamic potential. That is indeed the framework of linear irreversible thermodynamics and 
the monotonicity in the approach to equilibrium relates essentially to the stability of the 
equilibrium phase. 

The situation becomes much less clear when going to strong nonequilibrium regimes. Na- 
ture is full of stable nonequilibria for open systems in contact with different reservoirs, and 
yet no description in terms of thermodynamic potentials derived from energy and entropy 
(possibly supplemented with few other macroscopic quantities) has been found. In fact, oscil- 
lations of the macroscopic condition are very well possible and can be effectively described 
by various models of dynamical systems. But even restricting ourselves to a stationary 
macroscopic condition, or to a stationary open system in contact with large reservoirs, no 
physically clear monotonicity has been observed in the approach to nonequilibrium. The 
numerical results observed in [13] open a new route that needs further study. 

The present paper addresses that general theoretical question, restricting to the simplest 
context of Markov evolutions as described by Master or Fokker-Planck equations. It is 
true that there the relative entropy with respect to the stationary distribution is always 
monotone. Yet, that Lyapunov function is both well studied and not found directly related 
to known physical properties such as heat or work to which it relates under detailed balance. 
This paper looks elsewhere and we find a natural candidate for monotonicity to be the 
Donsker-Varadhan functional governing stationary dynamical fluctuations. It is physically 
related to the notion of dynamical activity, as will be explained below, a concept that has 
grown in importance for the elucidation of relaxation behavior in kinematically constrained 
systems. In ^13J we found that this functional is monotone in many examples. The present 
paper adds a mathematical proof but we need an extra assumption: we show that this 
Donsker-Varadhan functional is monotone in the approach to stationary nonequilibrium 
under normal response behavior which is precisely stated as the sufficient condition in our 



main Theorem |III.1[ We also add various examples that clarify the nature of that sufficient 
condition. As a result, the present paper is more technical than |d3j and we now enter into 
more specific details. 



Large deviation theory for Markov processes was developed by Donsker and Varadhan in 
1975, [5]. We recall the main setting. 
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Pt{u,x):=^I 5^„^ds, xeK (I.l) 







Consider an ergodic Markov jump process Pp with stationary probability law p and with 
transition rates k{x,y) over a finite state space K. The empirical fraction of time that the 
system spends in state x E K over time-interval [0, T] is 

r 

T 

where u = {xs,0 < s < T) is the piecewise constant trajectory. By the assumed ergodicity, 
Pt P for T t +00, Pp— almost surely. For the fiuctuations around that law of large times, 
there is a principle of large deviations, abbreviated as 

P>T ^fAoc e-'^^(^), T t +00 (1.2) 

for probability distributions p on K, in the usual logarithmic and asymptotic sense T +oo; 
see e.g. Oil]. Equivalently, for all continuous functions /, 

hm ilog(e/o"/(-OdA =Mfj2f{x)p{x)-I{p) 

X 

under the stationary expectation {■)p. 

I{p) = sup (- 5^ 44 5^ k{x, y) [g{y) - g{x)]) (1.3) 

over positive functions g. 

Since the functional X is strictly convex with unique minimum reached at the stationary 
distribution it is mathematically natural to ask whether X{pt) is also monotonically decaying 
to zero under the time evolution given by the Master equation 

^/ij(x) = ^[k{y,x) pt{y) - k{x,y) pt{x)], po = p 

ydK 

at least when p (the initial condition) is sufficiently close to p. We found numerically 
in many cases that the answer is yes, where the close-to-stationarity is verified for large 
times t. Then indeed pt gets sufficiently close to the stationary p. That was reported 
in p3]- A mathematical proof of monotonicity of the functional X{pt) for large times t 
is lacking and the present paper will still need an additional assumption, called "normal 
linear response." The normal linear response refers physically to the monotone decay of 
the linear response function, and mathematically it can be phrased as a sector condition on 
the backward generator L. The latter essentially means that the eigenvalues of L should be 
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contained in a wedge of the complex plane with a sufficiently small angle. In particular it 
will be easy to show that the monotonicity holds when the system satisfies the condition 
of detailed balance, and hence, by a continuity argument, the monotone return to steady 
nonequilibrium is also valid around detailed balance. Yet again, as we will see below, the 
monotonicity often continues to hold even beyond the linear regime around detailed balance. 



We now turn to the more physical motivation. Recently, from the point of view of 
nonequilibrium statistical mechanics, there has been great interest in dynamical fiuctuation 
theory, and in the occupation statistics in particular. The Donsker-Varadhan functional is 
exactly governing these fiuctuations as mentioned above. In that way our result mirrors 
the monotone behavior of the relative entropy which is associated to the static fiuctuations 
of the system, [H]. Apart from this more abstract analogy there are specific places where 
the functional X has turned up in nonequilibrium considerations. We know for example 
that close-to-equilibrium X is proportional to the excess in expected entropy production 
rate with respect to the stationary entropy production rate, [12], which gives a fiuctuation- 
based understanding of the minimum entropy production principle. Nonperturbatively, the 
functional X(/i) is an excess in expected dynamical activity (DA) as we now explain. 

Usually for jump processes, one calls dynamical activity the quantity defined on path- 
space that counts the number of jumps or transitions. Fixing any two distinct states x,y the 
expected rate of jumping x y when in x is of course k{x, y). Therefore, under distribution 
/i, the expected number of jumps per unit time is given by 

CifJ') ■= Yl ^(^) 5Z ^\ y) + f^iy)kiy, x)] 

X y x,y 

which is the symmetric counterpart of the current (formally with k{x,x) = 0). Since no 
confusion arises here, in the sequel we use the term dynamical activity for the functional 
^(/i) evaluating the expected value of the more commonly defined variable dynamical activity 
on path-space. The Donsker-Varadhan functional is the difference X(yu) = ^(/i)— ^y(/u) where 
^v- is defined like ^ but for modified rates ky{x,y) := k{x,y) exp{[V{y) — V{x)]/2} with a 
potential V so that the jump process with rates kv{x,y) makes /i stationary. That will 
be explained in more detail in the next section, and will be made most explicit in formula 



(II.7). The X(/i) is thus an excess in expected activity between the original dynamics and a 
modified dynamics for which n is made stationary. 
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On a broader level, the functional refers to a combination of properties of a 

statistical mechanical system that are related to its reactivity and the ability to escape from 
its present state. DA, and more specifically its version as defined on path-space, has been 
studied in connection with glassy behavior and the glass transitions; kinetically constrained 
models show a reduced dynamical activity over an extensive number of states which leads 
to dynamical phase transitions, [21 |6H8]. Finally, DA has appeared in fluctuation and 
response theory for steady nonequilibria, [H, [151 EB]- The point is that as a function on 
trajectories, the dynamical activity is time-symmetric and complements time-antisymmetric 
entropy fluxes whenever beyond the linear regime around equilibrium. That is why it 
enters the nonequilibrium fluctuation structure as well as provides extra contributions to 
the fluctuation-response relations. 



Concerning physical implications of the observed (and here partially proven) time- 
monotonicity of the Donsker-Varadhan functional, we should again compare with the sit- 
uation of relaxation to equilibrium. There the existence of a physically meaningful ("Lya- 
punov") functional, which does not increase over time, remarkably restricts the collection 
of admissible relaxation processes. Here we wish to proceed similarly to the strategy in 
equilibrium but we argue that out of equilibrium it may be useful to start from the DA as 
a fundamental quantity instead of from the entropy. The present paper contains no final 
judgement on this proposal but only a mathematically rigorous argument that this remains 
a valid possibility. It is proven that there is indeed a general tendency to decrease the excess 
dynamical activity analogous to the arrow of time associated with the increase of entropy 
under equilibrium condition. This is also related to the largely open problem of nonequilib- 
rium statistical forces: the monotonicity of the Donsker-Varadhan functional suggests that 
its gradient with respect to macroscopic parameters can play the role of nonequilibrium sta- 
tistical forces mimicking Onsager's theory of hydrodynamic entropy production. For some 
related physical arguments supporting the fundamental role of noise and dynamical activity 
out of equilibrium see e.g. [TO] . 



The next section specifies the mathematical set-up and the main definitions. Section III 



collects the main properties, with our result on monotone behavior. Section IV discusses 
various specific examples far and close-to-equilibrium. Proofs are collected in Section [V] after 
which a final conclusion follows. 
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II. SET-UP 

As in the previous section, we consider a Markov jump process on a finite state space 
K with states x,y,. . . and transition rates k{x,y). Probabihty distributions on K will be 
denoted by p, fi,^, . . .. The backward generator on functions / is 

Lf{x) :=J2H^,y) [f{y)-f{^)] 

and its transpose generates the Master equation 

^Ptix) + ^jf,,ix,y) =0, j^{x,y) := k{x,y)iy{x) - k{y,x)iy{y) (II.l) 

for the evolution on probabilities fit starting from some initial /io = /i on K. We assume 
that the Markov process is irreducible with unique stationary probability distribution p, i.e., 
p(x) > solves J2yjpi^^ = for all x E K. 

We say that the dynamics satisfies detailed balance when there is a function U on K for 
which 

fce(x,i/)e-^(^) = fce(l/,x)e-^(^), pe(a;) oc e-^(^) (II.2) 

Here and below we decorate the rates and the stationary law in that detailed balance case 
with the subscript 'e'. Then, the free energy functional 

J^if^) ■=^Kx)Uix) + ^ p{x) \ogp{x) > J'(pe) = - log ^ exp [-U (x)] 

satisfies the monotonicity J^{pt) i J^iPe) as a function of time t. That is just a standard 
consequence of the general monotonicity of the relative entropy under stochastic transforma- 
tions. However, the relation between the Shannon entropy — YlxPi-'^) loS/^(^) ^"^^ physical 
notions as work or heat is mostly lost when far away from detailed balance. A physically rel- 
evant alternative when moving away from detailed balance, is to consider the instantaneous 
entropy production S{p), which for the given context is 

p{x)k{x,y) 



p{y)k{y,x) 



^'^ (II.3) 

= 2 E U^^ y) M^^ yl y) ■= log -j^^y^^ 

as the product of "fluxes" j^{x,y) and "forces" A^{x,y) when the system's distribution is 
p, reminiscent of irreversible thermodynamics — see e.g. [TSj for more details. 
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We now introduce our main object. We embed the original dynamics into a larger family 
of processes with transition rates, 

kw{x, y) := k{x, y) exp ^^^^ ~ ^^""^ (II.4) 

parameterized by functions W on K. These functions W are also called potentials. Here we 
consider potentials that are directly connected with a probability distribution. What follows 
is a standard observation within the theory of large deviations, see e.g. Section 3.1.2 in [3], 



but for self-consistency we give a full proof in Section V A 



Proposition II. 1. For an arbitrary probability distribution ^ > there exists a potential 
V = on K such that fi is invariant under the modified dynamics with transition rates 
kv{x,y). The potential is unique up to an additive constant when the dynamics is irre- 
ducible. 

In other words, for arbitrary fi > we can always find a function V so that 

^[kvix,y) nix) - kviy.x) M] = 0, xeK (II.5) 

y&K 



We can compare this with (1.3). Indeed, the Donsker-Varadhan large deviation functional 
can be written in terms of a potential W: taking g = e^^^ in (|I.3l), 



X(/x) = sup ^ fi{x) [k{x,y) - kwix,y)] (II.6) 



x,y£K 



When the process is irreducible, cf. Proposition |II.1| and its proof in Section |V A[ we then 
have 

X(/i) = J2 /^(^) [^(^' y) - kv{x, y)] with V = V, (II.7) 

x,y(iK 

For physical motivation and as was mentioned already in Section |T| it is worth noting that 
X(yu) is an excess or difference between the expected escape rates ^^/^(x) JZy^i^^v) 

J2y^v{x,y). Such an expected escape rate estimates the dynamical activity, i.e., 
the number of transitions per unit time in the process. We refer to the physics literature for 
further discussion, P 121 EHU US] . 



III. MAIN RESULT 



For simplicity in the sequel we always assume the irreducibility of continuous time 
Markov processes with finite state space. Our main finding is that I{nt) is monotone 
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under the evolution (II. 1) when close enough to stationarity, i.e., for large enough times t 
compared to the relaxation time, at least under some further and physically interpretable 
condition. 

Define the real-space scalar product (/, g) := J2x fi^)9i^) P(^) so that (/, Lg) = {L* f, g). 
Here, we have introduced the generator L* of the time-reversed process. 

We write Lg for the symmetric part of the generator: Lg := \{L + L*), and 

Ill/Ill :=max|/(x)-/(y)| 
for the variation of a function / on K. Now comes the main result of the paper. 

Theorem III.l. Suppose that there is a constant c > 0, so that {Lsf,Lf) > c|||/||p for all 
functions f on K . Then, there is a time to > so that for all initial probability distributions 
fi on K, 

~f^if^t) < for all times t >to 



In section [V C| it will be shown that the time to after which monotonicity sets in is of the 
order of the relaxation time (inverse of the exponential rate of convergence). 

Since L and Lg have a bounded inverse on the functions / that have zero mean 



~ 0' condition of Theorem III.l in essence means to require that 
{Lgf, Lf) > for all non-constant /. In fact, it is sufficient and more convenient to verify 
the inequality 

(/,lV)>o (III.l) 

which is usually called (a specific instance of) a sector condition. In particular, for L 
a normal operator this is equivalent to the assumption that all its non-zero eigenvalues 



A = —a + ib 7^ obey the inequality 9? (A ) > 0, i.e., \b\ < a. Obviously, the condition (III.l) 



is fulfilled whenever the rates k{x,y) satisfy detailed balance (II. 2), Le = L*, see under the 



section IV B for further discussion. By a continuity argument, this also extends to dynamics 



where the detailed balance is only weakly violated. 
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A physical interpretation of the hypothesis for Theorem III.l is in terms of the generahzed 
susceptibihty for the hnear response around the stationary probabihty p. For a function B 
on K consider perturbed transition rates 



k{T;x,y) := k{x,y)e 2 



•^[BiyyBix) 



T> 



(111.2) 



with small time-dependent amplitude h^-, Ih^-l < e. It resembles (II.4) but now the pertur- 



bation is time-dependent. That new time-dependent process is started from time zero in the 
distribution p which is stationary for h = 0. At a later time t > 0, in the process with rates 



(III. 2), when taking the expectation of a function G, we see the difference 



which defines the generalized susceptibility Xgb- There is an explicit formula extending the 
standard fluctuation-dissipation theorem, see e.g. pLj: 



XGB{t) := 



h=0 



d 

di\ 



lB{xo)G{xt) 



LB{xo)G{xt) 



(III.3) 



with right-hand expectations in the original stationary process Pp. Our next result gives an 



explicit expression for the zero-time susceptibility in the case G = B; see Section [V D| for a 
proof. 



Proposition III. 2. We have the identities 

d 



dt 



Xffif) 



XLfAO) = -iLJ,Lf) 



(III.4) 



As a consequence, the hypothesis of Theorem III.l can be rephrased as the condition 
Xffit) ^ X//(0) for small enough t > 0. Such an equilibrium-like response behavior at 
initial times is called "normal linear response" throughout the paper. 



IV. EXAMPLES 



We illustrate the statements of the previous section by providing some examples. 



A. Asymmetric diffusion on the ring 



Consider a ring consisting of > 2 sites, labeled x = l,2,...,A^ + l = l. For a totally 
asymmetric random walker the only non-zero transition rates are of the form k{x,x + l) > 



10 



with Master equation (II.l) simplified to 



dt 



(x) = — l)k{x — l,x) — fit{x)k{x, X + 1) 



The stationary distribution is 

p(x) 



C 



k{x, X + 1) 



1) ' k(x, X 



k(x, X + 1) 



The corresponding generators of Theorem III.l 



are 



Lfix) = kix,x + l)[fix + l)-fix)] 
LJ{x) = ^k{x, X + + 1) + fix - 1) - 2f{x)] 



so that the hypothesis of Theorem III.l 



concerns 



C2 



(IV. 1) 



Homogeneous case. Let k(x,x + I) = p for some given p > 0. In that case, ( |IV. 1 ) 
is bounded from below by the variation of / because, with g{x) = f{x + 1) — f{x), 
T.x9ix)[g{x) - g{x - 1)] = | ^^[g{x) - g{x - l)f > on the ring. 

But we can also explicitly show that X(/ii) is monotone for all times t > and starting from 
all possible /i > 0. For this we find the potential solving 



or 



V{x + l)-V{x) , , , 1 v^, 

^ ^ ^ = - log + - log ii{y) 



Therefore the Donsker-Varadhan functional (II. 7) equals 



X 

N 

= P-pNlYlfiiy) 



V(x+1)-V(x) 
2 



y=l 

in terms of the geometric mean of the /i(l),yu(2), . . . ,fi{N). The time derivative at fit 
is computed to be 

^x„,^v[n.(.fE(^- 

y=l X=l r \ / 
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which is non-positive by applying Jensen's inequahty as 

log I i-r > 1 > ^ y:iog^^^ =0 




N 



In fact, by the same argument, the time-derivative is strictly negative whenever ^ ^ p. 
Therefore, for homogeneous totally asymmetric walkers on a ring, we always have 
monotonicity of the geometric mean of the occupations fit{x), as a consequence of the 
monotonicity of the Donsker-Varadhan functional. 



Inhomogeneous case. We look back at (IV. 1) which is now of the form ■^^g{x)[g{ 



g{x — l)], always with (^(x) = f{x) — f{x — l). An explicit computation of the time-derivative 
of X(/it) gives, with nt = n, 



d 

dt 



(IV.2) 



with V{x) = —h{x) + J2x ^(^) I'o^ /^(^) ~ P(^)[l + ^ h{x)]. We thus see how the condition 
in Theorem |III.1| appears. Without further condition and depending on the shape of the 



stationary distribution p, this time- derivative (IV.2) can be either positive or negative. 
For an example making X(/if) non-montone at initial times, we take = 4 with rates 
k{l, 2) = 30, k{2, 3) = k{3, 4) = k{4, 1) = 1, and /i determined from e = 0.02 and 



V{1) = 1, 1/(2) = -3, V{3) = 0, 1/(4) = 2 



(IV.3) 



Then the time-derivative (IV.2) is positive whenever 

1 12 4 

> + 



P(l) P(2) P(4) 

To visualize this example we show in Fig. [ijthe result of a numerical computation of I{pt) 



for this initial condition (IV.3). Observe however, even in this example, that after a short 



initial slip X(/it) starts decreasing monotonically. In other words, while for all e > there 
is a probability fi in the neighborhood of the stationary law p with variational distance 
d{p, p) < e, so that T{pt) is not monotone at pt = P, still T{pt) decays monotonically to 
zero eventually (after a long enough time t). This also indicates that the hypothesis in 
Theorem III.1| is not at all necessary. 
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FIG. 1: The functional X(;Uf) as a function of time. The curve with open circles shows the evolution 
of I{fJ-t) for the case of a homogeneous stationary distribution. The black curve (closed smaller 
circles) represent the case where the stationary distribution is inhomogeneous: p(l) = 1/91, /j(2) = 
p(3) = p(4) = 30/91. 



An example of a driven diffusion process on the ring was treated in |13j. There, in Fig. 1 
of [13], we have seen that X(/it) keeps decaying monotonically while the entropy production 



£{fj,t), the continuum version of (II.3), oscillates in time. 



B. Detailed balanced dynamics 



Under detailed balance (II. 2), we can take g = \/ Pej \^ in (1.3) to find equality with the 
Dirichlet form 



[X) il ^^^(l,J — ][X) 



Furthermore, for /zj = /x at time t 

so that we get the time derivative 

d 



Pe{x) V \ p, 



Pt = PeLei — ) 
Pe 



p IP 

1 



dt 



UPt) = -J2^{Lj'){x) (LJ)( 



X] 



(IV.4) 
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where we have abbreviated / = a/ yu/Pe- Obviously, that time-derivative is negative whenever 
/ — 1 is sufficiently small (close-to-stationarity): with /(x) = 1 + eh{x), 



That is equivalent to what was mentioned before under Theorem III.l: the hypothesis 
there is always satisfied under detailed balance, and we see that the time to will be of 
the order of the relaxation time, characterizing the uniform exponentially fast convergence 



to equilibrium. More explicit calculations reveal also that the derivative (IV.4) is strictly 
negative for all / > when \K\ < 3. 



On the other hand, we can check that the time-derivative (IV.4) may obtain positive 



values too. For convenience, we briefiy consider a one-dimensional diffusion variant of the 
same problem, with the forward generator 

L =— — ( —) 
^ Pe dx da; 

for smooth functions g. Let us take [i[x) = a/pe{x) inside the interval [1,^], where i > 1 
and a is a normalization, and ~ Pe{x) very rapidly decaying to zero outside that same 



interval. Then, at that p, (IV.4) becomes 

^X,(p0^-2 tdxf'ix) (log/)"(x) 



which will be positive e.g. when / is convex while log/ is concave — for example, with 
Pe{x) = Ci/x"^ on we have /(x) ~ x^, log/(x) ~ logx on that same interval. 

V. PROOFS 



A. Proof of Proposition II. 1 



For arbitrary /i > we consider the auxiliary functional 

Yf^iW) := ^ fi{x)kwix,y) = ^ iJ,{x)k{x,y) exp 

x,yGK x,y(iK 



W{y) - W{x) 



(V.l) 



defined on all functions on K. Of course, since the value only depends on the differences 
Will) — W{x) we can as well take W G Cq{K), the collection of all functions that are equal 
to zero on a fixed "root" xq G K. This functional is nonnegative and convex. 



Y^{XWr + (1 - \)W2) < XY^{W,) + (1 - \)Y,{W2) 



(V.2) 
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by convexity of each contribution fi{x) kw{x,y). Below in Lemma V.l we prove that under 
the irreducibihty assumption, is actually strictly convex and that it attains inside Co{K) 
a unique minimum at some W = W^. Hence, is also a minimizer (unique up to an 
additive constant) on the unconstrained space of all functions on K, implying that for all 
X e K, 







SY„, 



5W{x) 



W=Wa 



I'^iM kw{y,x) - fi{x)kw{x,y)] 



(V.3) 



which is just the stationarity of /i for the dynamics with rates ky[/{x,y), i.e., = of 



Proposition II. 1 does exist and equals W^. This also proves formula (II.6) as 



^(a^) = ^) ~ = sup Kx) [k{x, y) - kv{x, y)] (V.4) 

x,y(iK ^ x,y£K 

A general reducible dynamics can be decomposed into irreducible components (including 
isolated sites) and for each of them the above argument holds true, i.e., the supremum 



on the right-hand side of (II. 6) is attained on a function V^, which is also a solution of 
the inverse stationarity problem and which is unique up to a constant within each component. 



Again turning to irreducible dynamics, we have 

Lemma V.l. For any fi > 0, Y^\cq{k) is strictly convex and has a unique minimum. 

Proof. By irreducibihty, there exists a cyclic sequence of states {xq, Xi, x„ = Xq) that cov- 
ers the whole space K and such that for all consecutive pairs of states, /x(xi_i) A;(xj_i, Xj) > S 



with some 6 > 0. If Wi and W2 are such that the relation (V.2) becomes an equality, then, 
for alH = 1, . . . , n, Wi{xi) — Wi{xi-i) = W2{xi) — W2{xi-i), by using that the exponential is 
strictly convex. From Wi{xo) = ^^2(^0) = then follows Wi = W2, identically. This proves 
the strict convexity and hence the uniqueness of the minimum for Yf^\co(K)- 
To prove that the minimum exists, we consider the compact sets 

Q(K) := {W G CoiK); \W{x)\ < a for all x}, a > 

and define := y^(0) = yfzx f^i^) k{x-,y)- By construction, for any W G Co{K)\Cq{K) 
there exists i such that W{xi) — W{xi^i) > a/n and hence Y^{W) > 5 e'^^^'^'^\ Fix now some 
a so that (5e'*/''^"^ > M^. By compactness, Y^ on the set Cq{K) attains the minimum, which 
then coincides with the minimum of l^|co(-ft:)- D 
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B. The map /n-?- Vf^ 

Most importantly, from the previous section, the map ^ ^-^ is a bijection when we 
think of the potential modulo a constant. Moreover depends smoothly on fi, and vice 
versa. In other words, the map n ^-^ is a. diffeomorphism with variational distance d(/i, p) 
of the same order as V: 

cod(/i,p) < IIIV^III < cid(/i,p) 

for constants Cq, Ci > 0. That is really a consequence of the irreducibility of the finite Markov 
process, or see chapter two in [H]. 

Heuristically it suffices to understand the linearized map around fi = p,Vp = since 
the modified rates fcvi+yal^'Z/) = f^Vi{x,y) exp{V2{y) — V2{x)}/2 each time define an irre- 
ducible Markov process for each Vi. Writing /i = p(l + eh) for some function h with mean 
p(x)/i(x) = and for small e, we easily find V^ = ev + Oi^e^) with 

LsV = L*h (V.5) 

Note here that p is also invariant under the time-reversed process and under the (detailed 
balanced) process generated by L^. Hence, p{x)L*h{x) = and L*h is in the domain 



of the (Drazin) pseudo-inverse (L^) ^, so that (V.5) has a unique solution (again up to a 
constant); in fact /i = if and only if f = 0. 



The computation leading to (V.5) goes as follows. For all x E K, 

= ^{p{y)k{y, x)e^^^^ - p{x)k{x,y)e ^"'2 ^ ') 
y 

which by expanding the exponential directly yields the identity 

,p 



L* - 1) (x) - LsV^ix) = w{x, p) (V.6) 



where (with V = V^ 
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for Sv{x,y) := 'Zn=2[ 



V{x)-V{y)in 1 



. Each difference 



p{x) 



- 1 



< CnWW, 



Ml v'Mllh 



X e K 



so that \w{x,fi)\ < Ci |||V^||P for some constant Ci when |||V"^||| is sufficiently smalL 



C . Proof of Theorem HTLTI 



We must take the time-derivative of T{fit) 
d 



dt 



X 



x,y 



+ \ ^l^t{.x)kv,{x,y) [Vt{x) - Vt{y)] 



x,y 



where Vt{x) := -^V^j(x). The second hne in (V.8) equals zero because per fixed time t, fit is 



stationary for the dynamics with rates ky^{x,y). We thus have 
d_ 

dt 2 



^(/^t) = -^Yl [LVtix) + 2 ^ k{x, y)6v{y, 



X 



Looking at the first term, we use that 



llt{x) = p{x) - = p{x)LsVt{x) + p{x)w{x, pt) 



as introduced in (V.6). In other words, we have obtained 

-T{pt) = -]^QiVt) - p{x)w{x, pt) LVt{x) -^ptix)k{x,y)6v,iy,: 



d 

dt' 



for the quadratic form Q{f) := {Lf,Lsf) = {f,L*Lsf) = {LsLf,f) which, from the hy- 
pothesis of Theorem III.l, is bounded from below by c|||/||p. Since |||VJ||| < -R'exp[— 7t] 



for some ii" < oo, 7 > 0, it suffices finally to realize that, at least for large enough times t, 



^X]p(a;)w(x,;Ut)LV;(x) + ^ pt{x)k{x,y)6vXy, 



x\ 



< ciiiv;i 



for some C < 00. That easily follows by applying uniform bounds such as 
< C2 infill and \6v{x,y)\ < C3|||V||p for small enough V, combined with 
the previous estimate \w{x,p)\ < C'lUlV^HP making also < C4|||Vt|||. That 

concludes the proof of Theorem |III.l 
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The proof above obviously gives an estimate of the time to after which monotonicity surely 
sets in. Since |||V^||| is of the order exp(— 7t), QiVt) > dominates the time- derivative of 
the Donsker-Varadhan functional when 7^ ^ 1, i.e., for times beyond the relaxation time to 
the nonequilibrium steady regime. 



D. Proof of Proposition III. 2 



A straightforward computation gives, for all t > 0, 

1 [d 

-\f{xo)f{xt) ^ ^ 



= -\{{L + V)f{xo)f{xt)) 



and hence 



It 



Xff{t) 



-(LJ,Lf) = -Qif) 



Similarly, we look at the response of the observable Lf to find 

d 



XLf,f{t) 



Xl/,/(0) 



1 

^^-(^{L* + L)f{xo)Lf{xt)^^ 
-{LJ,Lf) 



(V.9) 



(V.IO) 



(V.ll) 



In particular, the equality (V.IO) = (V.ll) shows that at equal times we can commute the 



time-derivative and the derivative with respect to the perturbation. 



VI. CONCLUSION 



The Donsker-Varadhan functional is related to the dynamical activity as recently studied 
in constructions of nonequilibrium statistical mechanics. We have given a necessary con- 
dition for its monotonicity under the Master equation. The condition was called "normal 
linear response," as it requires the generalized susceptibility to initially decay in time. We 
have given also examples where that condition fails and where the dynamical activity starts 
out being non-monotone. It remains open to understand why in those models where that 
sufficient condition is violated the large-time behavior of the activity is still monotone as 
observed numerically. 
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